Guiding Questions for 
Data Analysis, by Reports 



April 2015 


The following document is provided by the Data and Accountability Department staff as a resource to 
help guide your review of student data. This document provides examples of questions to consider 
when reviewing frequently accessed reports located in Case21 , Quickr, EVAAS®, mClass®, or 
PathDriver. The questions provided are not an exhaustive list but are meant to guide your discussions 
as you review the data contained in the report. 
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CASE21 REPORTS 


Examples of questions to ask: 


Class Report 


CLASS 2013-14 Benchmark Year Round/Traditional 

REPORT 6th Grade ELA 3rd Administration 

To see a brief video on how to use this report, scan the QR code located at the top left or go to http://youtu.be/veqoa YCKhiw. 
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❖ Which students are showing mastery and which are not? 

❖ What are the characteristics of students who are showing mastery and 
those who are not? 

❖ How do the results for this class compare with other classes at this grade 
level? 

❖ How do the results for this class at this grade level compare with the rest of 
the district? 

❖ What class strengths/weaknesses does this data highlight in terms of Depth 
of Knowledge and Content? 

❖ What trends are you noticing across classes or sections? 

❖ What instructional strategies can be implemented that are most effective 
for targeted groups of students? 

❖ What else needs to happen in order to meet the needs of target groups of 
students? 


Item Analysis 



❖ What student strengths/weaknesses does this data highlight? 

❖ On which objectives do students need enrichment? reteaching? 

❖ What factors may have influenced performance on this objective? 

❖ What is the variation in students' skills (in a specific area) within each of my 
classes/sections? 

❖ What results concern you the most? 

❖ What patterns or trends are emerging among the data? 
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School Report 


SCHOOL 2012-2013 Benchmark Year Round/Traditional 

REPORT 6th Grade Math Plus 1st Administration 



❖ What student strengths/weaknesses does this data highlight? 

❖ What teacher strengths/weaknesses does this data highlight? 

❖ What trends are you noticing across classes and/or sections? 

❖ How do our results for this subject area at this grade level compare with the rest 
of the district? 

❖ What trends are you noticing across assessments? 


QUICKR REPORTS 


Examples of questions to ask: 


Disaggregated Charts 


Performance Composite by Subgr oup 
All EOG Tests and Alternative Assessments 
Grades 3-5 
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❖ Which groups are demonstrating higher/lower proficiency rates? 

❖ How consistent are those patterns over time? Across grade levels? 

❖ How do those patterns compare to district patterns? 

❖ Are these patterns consistent with other classroom data we have about our 
students? 

❖ How are we assigning our highest/lowest subgroups across classrooms? 

❖ How are we aligning our resources and allotments to support our neediest 
subgroups? 


AMO Status Report 

AMO Status Report 



PERCENT PROFICIENT BY SUBGROUP 



❖ Which subgroups are demonstrating higher/lower proficiency rates? 

❖ How consistent are those patterns over time? Across grade levels? 

❖ How do those patterns compare to district patterns? 

❖ Are these patterns consistent with other classroom data we have about our 
students? 

❖ How are we assigning our highest/lowest subgroups across classrooms? 

❖ How are we aligning our resources and allotments to support our neediest 
subgroups? 
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End of Year Roster 
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❖ Which individual students were/were not proficient? 

❖ What are the characteristics of students who performed well/poorly? Are there 
any similarities that stand out? 

❖ Which individual students have shown patterns of poor achievement over time? 

❖ Which individual students had a result this year that is inconsistent with their 
achievement history? 

❖ What are the possible root causes for what you are noticing with your student 
data? 


Current Student Roster 
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❖ What does the data suggest about the students currently enrolled in your 
building? 

❖ What did you notice when you analyzed the student data for patterns? Were 
there any surprises or new questions? 

❖ What trends exist when reviewing student data using multiple assessments (e.g., 
Case 21, EOG/EOC, Universal Screenings)? 

❖ What do you see when you look at groups of students for individual teachers? By 
grade level? By subject? 

❖ What strategies might you consider that would be effective when working with 
specific groups of students? 

❖ What are the possible root causes or symptoms of the identified student 
performance? 
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CogAT 


CogAT 


LIST OF STUDENT SCORES 

Cognitive Abilities Test ™ (CogAT®) 


tt MAKE COUNTY Rt 



Which students are considered at-risk? are considered gifted? 

What student strengths/weaknesses does this data highlight? 

Are there other sources of data that can be used to triangulate and affirm these 
results? 
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Assessments 
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Which AG literacy/math services should be provided based on the individual 
results? 
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EOG Goal Summary Report 


LEASchCode = 


SchooiNarae = . 

Developmental Number Pet of WeightedDiff from 2013 

Scale Score of Valid Read Items Mean State Mean 
Mean Scores per Form *Pct CorrectPct Correct * 
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❖ What is the weighted distribution of the content goals/objectives as they are 
represented on the test? 

❖ Were there specific goal areas that were significantly higher/lower than the state 
benchmark? Higher/lower than in previous years? 

❖ Does the percentage of time spent teaching the goal areas match the percentage 
of items represented in the test? Should it? 

❖ How do the same goal areas compare between teachers of similar classrooms? 

❖ Which teachers stand out in particular goal areas? 

❖ What content strengths/weaknesses do the incoming students of a particular 
grade bring with them? 

❖ If a teacher has several years of goal summary data, does s/he see trends when 
looking at several years of data? (Remember that one year can sometimes be 
misleading.) 


BOG3 Results Report 
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❖ 

What strategies will be used to ensure that at-risk students are proficient at the 
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❖ 

Are the reading materials selected for the students aligned with their Lexile 




scores? 
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ACT Explore/Plan Score Report 


PLAN 



Profile Summary Report: Presentation Packet 



Profile Summary Report: Presentation Packet 


❖ How did your students perform on the Explore/Plan tests compared to other 
students nationally? 

❖ Do your students' Explore/Plan scores differ by race/ethnicity background and 
gender group? 

❖ Which students are on track to be college ready when they graduate? 

❖ Which content skills are strong and which content skills need to be addressed? 

❖ What are your students’ self-reported educational and career plans? 

❖ How do your students' Explore/Plan scores relate to the courses they have taken 
or are currently taking? 

❖ How do your students' Explore/Plan scores and coursework plans relate to their 
educational plans? 

❖ How do your students' Explore/Plan Composite scores/coursework plans relate to 
their expressed needs for help? 

❖ How do your students Explore/Plan Composite scores, coursework plans, and 
postsecondary plans relate to their career preferences from the Career Areas 
List? 

❖ How do your students' Explore/Plan composite scores, coursework plans, and 
postsecondary plans relate to their career cluster from the World-of-Work Map? 

❖ Has this information been shared with your school counselors to be used as they 
work with students? 


PLAN: Predictions of AP Success Report 
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❖ Which students are predicted to be successful in AP courses? 

❖ Are the students identified in the report already enrolled or have a plan to enroll 
in AP courses? If not, what supports are needed? 

❖ Are there structures in place to offer the AP courses identified in the report at this 
school? If not, how do we support the students needing those courses? 

❖ Has this information been shared with your school counselors to be used as they 
work with students? 
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REPORTS in EVAAS 


Examples of questions to ask: 


School Value Added Report 



❖ What is the average progress of students in this building? by grade level? by 
subject? 

❖ How does your school's progress rate for a grade compare to the growth standard 
(average growth for students statewide)? 

❖ How does your school's achievement level compare to the state's average 
achievement? 

❖ What trends exist within each content area or grade level? 

❖ Do you have historical context that increases your understanding of the trend or 
lack of a trend (e.g., turnover in staff, change in makeup of the student body, or 
change in test and/or curriculum and the response to those changes)? 


School Diagnostic Report 



M 2014 EH Previous Cohort(s) — Reference Line — Standard Error 


'Ml students across the state who look the same test are assigned tn one of live equal 
groups according to each student's average level of achievement. 
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Remlrnii Reference Ure 0 0 0 0 0 0 0 0 0.0 

2014 Growth -UB -3 3 4<i 0 4 »tl 
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❖ Are students at each achievement level making appropriate growth? 

❖ How does the pattern of the growth bars for the current year (blue) compare to 
the previous cohort's bars (gold)? What changes occurred at the school/district to 
influence the difference in growth patterns? 

❖ Which groups are making more/less growth than other groups? 

❖ What trends are you noticing when reviewing data from various subgroups? 

❖ Are these patterns consistent with past cohorts of students? 

❖ Are these patterns consistent with other classroom data we have about our 
students? 

❖ How are we assigning our highest/lowest achieving students across classrooms? 
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School Academic Preparedness Report 
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Students whose probability of proficiency ib greater than or equal to 70% 
Students whose probability or proficiency is between 40% and 70% 
Students whose probability of proficiency is less than or equal to 40% 
Students who do not have a prolection due to a lack of sufficient data. 


❖ What proportion of students is on path to academic success (green slice)? What 
enrichment strategies can be provided to ensure that they maintain their 
likelihood of being proficient? 

❖ What proportion of students is at risk for not scoring in the proficient range 
(yellow slice)? What targeted interventions can be provided to increase their 
likelihood of being proficient? 

❖ What proportion of students is unlikely to score in the proficient range (pink slice)? 
What sustained interventions are needed to increase their likelihood of success? 

❖ When combined with other data, does this data confirm your knowledge of 
students' performance risk? 


Student History Report 



❖ What patterns are evident given the student's testing history on prior 
assessments? 

❖ How does this student compare to school, and district scores? 
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Student Projection Report 
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❖ Based on the assessment history and projections, is the student currently enrolled 
in the appropriate courses? 

❖ What is the student's projected state percentile and their probability for reaching 
each of the state's achievement levels? Does the data confirm your knowledge of 
the student's performance risk? What actions are currently needed (e.g. 
interventions, enrichment)? 


Custom Student Report 

❖ 

Who are the students with similar characteristics (e.g., grade, race, sex, 

Who ire currently enroot* In » Airy Grade » 

Adams Elementary 
Alston Ridpe Efomotrtaiy 
A*ev Elementary 

*•» Middle 


demographics)? What patterns can be observed in their projections? 

For a specific subject level test, who are the students with similar probabilities of 

Athens Drwe High • 

Mafc-frog ito (o/JUoev ^ ^ ^ spites 

American Iniftar Male Students Mlh DeatnllUos 

Asian *wnne Limited EncAeh Proftciencr 

Biach unknown <se*> Acaoemit a»w or mteaectuaity oifled 

❖ 

success? 

Who are the students in need of sustained academic intervention by grade level, 

TWo or Mom Rates 
unknown (Race) 

MNfc «n#j» propctidptokct*/*** 

❖ 

by subject? 

Who are the students in need of more rigorous course sequences by grade level, 

Teel Suteect (level) Lower \ Upper % 

-Teste- • - Suojects (Loref) - • 0 0 ‘JS3L4& 


by subject 
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Student Pattern Report 
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(Note: In order to create a report , you must select at least 15 students who have both 
previous and current year scores in the currently selected subject.) 

❖ When reviewing the Student Pattern List, what patterns do you notice when 
comparing students' previous year NCE scores to current year NCE scores? 

❖ How effective has your school been with the lowest, middle, and highest achieving 
students in the group you have selected. Did this particular group of students 
receive a specific intervention (e.g., tutoring, targeted instruction, etc.)? 

❖ Which groups of students (based on your selection) made about the same, less or 
more progress than the state growth standard? 


Teacher List by School 
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Meets Expected Growth 
Meets Expected Growth 


Who are your teachers that did not meet/meet/exceeded expected growth within 
each grade level or subject area? 

Which teachers are in need of support? 

What does this data tell you about specific grade levels or subject areas? 

How much progress did teachers who met or exceeded expected growth make 
with specific subgroups of students (e.g., low, middle, high, race, gender, etc.)? 


Evaluation Composite 


2014: E*p«ct*d Qrowth 



❖ Which of your teachers' Evaluation Composite was in the "did not meet expected 
growth" category? 

❖ What support can be provided to these teachers? 

❖ Who are your "exceeds expected growth" teachers? What support can they 
provide other teachers? 
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Teacher Value Added Report 




— Average Teache in District 


2012 1.2 

2013 10 



How does the teacher's growth measure compare to the standard for academic 
growth (green vertical line (0.0))? 

How does the teacher's index score compare to the average teacher in WCPSS? 
How effective has the teacher been when looking across multiple years? 


Teacher Diagnostic Report 
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❖ Which groups of students (e.g., low, middle, or high) did the teacher show the 
most progress toward academic growth compared to other students across the 
state who took the same test? 

❖ Which achievement level group represented the majority of the teacher's students 
(e.g., majority low or high)? What are the implications? 

❖ How much progress did the teacher make with particular subgroups of students 
(e.g., race, sex, or other demographics)? 

❖ What trends are noticeable with the individual student data? 

❖ What strategies might help this teacher work more effectively with students in a 
subgroup? 
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Teacher Custom Diagnostic Report (with student lists) 


pacftei Diagnostic Summary 


Teacher Value Added Teacher Diagnostic Teacher Custom Diagnostic 
Titer By: Subgroup 
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How much progress did students who received a particular intervention make? 
When viewing the student list within the Teacher Custom Diagnostic, were there 
any noticeable trends with individual students? 

How many or what percentage of the teacher's students experienced an increase 
in their NCE scores when compared to the previous year? 


REPORTS in mCLASS® 


Examples of questions to ask: 


Class Summary Report 



❖ What patterns or trends do you notice? 

❖ What percent of the students in this class are in the proficient range? the strategic 
range? the at-risk range? 

❖ What are instructional areas of strength or weakness? 

❖ How does the DIBELS Next Composite data align with the TRC data? 

❖ Are there surprises in the data? 
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Student Summary Report 



❖ What do you notice about the student composite scores and individual probe 
scores? 

❖ Which students need specific interventions? 

❖ Which students are in need of Progress Monitoring (given the Steps for Effective 
Progress Monitoring)? 

❖ Which students are showing growth over time? 

❖ How do students' measures or progress monitoring compare to the growth of 
their peer group? 

❖ What are your next steps? 


Student Probe Detail Report 



❖ What are students' strengths or areas for growth? 

❖ What patterns do you notice? 

❖ If students are receiving intervention for a specific skill deficit, is it impacting their 
assessment results? 

❖ Are there other sources of data that can be used to triangulate and affirm these 
results? 


Reading 3D Measures Breakdown 



❖ How have your students progressed in different areas over time? 

❖ What are instructional areas of strengths or weaknesses? 

❖ Where should you focus instructional resources? 
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Reading 3D Comparing Measures Report 


Comparing Measures on mCLASS:Reading 3D 

By School l or AOam* Ltementary c*my !mm NC 


iiLJb 
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❖ How have different student populations changed over time? 

❖ On which grade levels should resources be focused? 

❖ What are instructional areas of strengths or weaknesses? 


DIBELS Effectiveness Formula (DEF) Report 



❖ Is your instructional program effective at moving students from high risk to low 
risk? 

❖ Of the students who were red last period, how many have moved up to yellow or 
green this period? 

❖ Of the students who were green last period, how many have slipped back to 
yellow or red this period? 


Reading 3D Growth Report 



❖ How has student achievement changed over the course of this year? 

❖ Are students on track to meet end-of-year goals? 
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REPORTS in PathDriver 


Examples of questions to ask: 


Student Universal Screening Report 

Class results from July 16, 2014 to September 25, 2014 3:34 PM 

Results for the Winter, Spring period(s) will be graphed when there are at least 5 scores in 
the class. 



❖ What level of literacy/math support might be needed for students to master 
content standards? 

❖ Could a student have underlying skill deficits that may be impacting performance? 

❖ How is the student progressing relative to national norms? 

❖ How do the student's scores compare with class, school, and district benchmarks? 


Student Test Summary (Math Only) 

❖ What percentage of questions did students answer correctly and incorrectly in 
each category? 

(Junction type Cumacl Jncnrrcct 1 Imnd ntiE rot oH ■>„ cinjn'ert 
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❖ How many questions are in each category type? 

❖ Could time have been a factor that impacted students' performance? 

❖ Are there specific focus areas where a student may benefit from additional 
support? 

❖ Could students have underlying skill deficits that may be impacting performance? 
If so, what supports are needed? What are the implications for instruction? 

hractiiHi Uanlput-sriwi 
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Student Test Details (Math Only) 



❖ Which questions did the student answer correctly or incorrectly? 

Synem 5r3i«iti CUiSvi Uun Re part,*, 

❖ How long did the student take to answer each question? 

- 1 Which Is ftiqt-s/ Anfrvrei' RvspoFm T i mx t-iikci i 

1 J WS S-&3 

2 H/12 ar a/1 i n.ni J S/ll I H 

2 1/2 9f 2/2 2/2 X 1/2 2.43 

❖ What are the implications for instruction? 
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Universal Screening Summary Report 
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How is the class progressing relative to national norms? 

What level of literacy/math support needs to be embedded into core instruction 
for a particular class? 

What level of differentiation may be needed for a particular class? 


Class Universal Screening Details Report 
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❖ How do students in the class compare to each other? 

❖ How many students in the class should have their progress monitored (i.e., how 
many fall below the cut points)? Who are these students? 

❖ How many students in the class currently have a progress-monitoring assessment 
schedule? Who are these students? 

❖ Which students may need additional support? 
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